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Modifications  and  Alternatives  to  the 
Cubic  Interpolation  Process  for  One-Dimensional  Search^ 

by 

2 3 4 

A.  MIELE  , F.  BONARDO  , and  S.  GONZALEZ 

Abstract . In  this  paper,  the  numerical  solution  of  the  prob- 
lem of  minimizing  a unimodal  function  f(a)  is  considered, 
where  u is  a scalar.  Two  modifications  of  the  cubic  inter- 
polation process  are  presented,  so  as  to  improve  the  robust- 
ness of  the  method  and  force  the  process  to  converge  in  a 
reasonable  number  of  iterations,  even  in  pathological  cases. 
Modification  Ml  includes  the  nonoptional  bisection  of  the 
interval  of  interpolation  at  each  iteration  of  the  process. 
Modification  M2  includes  the  optional  bisection  of  the  in- 
terval of  interpolation:  this  depends  on  whether  the 

slopes  f (a  ) and  f (a  ) at  the  terminal  points  a and  t of 
a o a o ^ o o 
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two  consocutiivo  iterations  have  the  same  sign  or  opposite 
sign. 

An  alternative  to  the  cubic  interpolation  j^rocess  is 
also  presented.  This  is  a Lagrange  interpolation  scheme  in 
which  the  quadratic  approximation  to  the  derivative  of  the 
function  is  considered.  The  coefficients  of  the  quadratic 
are  determined  from  the  values  of  the  slope  at  three  points: 

, and  = (a^+a2)/2,  where  and  are  the  end- 
points of  the  interval  of  interpolation.  The  proposed  al- 
ternative is  investigated  in  two  versions.  Version  A1  and 
Version  A2 . They  differ  in  the  way  in  which  the  next  in- 
terval of  interpolation  is  chosen;  for  Version  A1 , the  choice 
depends  on  the  sign  of  the  slope  for  Version  A2,  the 

choice  depends  on  the  signs  of  the  slopes  f (a  ) and  f (a.,). 

a o a 3 

Twenty-nine  numerical  examples  are  presented.  The 
numerical  results  show  that  both  modifications  of  the  cubic 
interpolation  process  improve  the  robustness  of  the  process. 

They  also  show  the  promising  characteristics  of  Version  A2 
of  the  proposed  alternative.  Therefore,  the  one-dimensional 
search  schemes  described  here  have  potential  interest  for 
those  minimization  algorithms  which  depend  critically  on  the 
precise  selection  of  tlie  stepsize,  namely,  conjugate  gradient 
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1 . troduction 

Many  algorithms  for  mathematical  programming  problems 
consist  of  two  parts:  the  computation  of  the  search  direction 
and  the  computation  of  the  stepsize  along  the  search  direction 
chosen.  The  computation  of  the  stepsize  is  done  by  means  of 
one-dimensional  search  schemes,  whose  nature  (i.e.,  approxi- 
mate or  precise)  must  be  tailored  to  the  characteristics  of 
the  algorithm  under  consideration. 

For  algorithms  of  the  pointwise  type  (i.e.,  ordinary 
gradient  method  and  quasilinearization  method) , approximate 
search  schemes  can  be  employed.  On  the  other  hand,  for 
algorithms  of  the  cyclic  type  (i.e.,  conjugate  gradient 
methods  and  variable-metric  methods) , precise  search  schemes 
are  desirable  (see,  for  example.  Refs.  1-3). 

Among  the  search  schemes  available,  one  of  the  most 
widely  used  is  the  cubic  interpolation  process  (see  Ref.  4). 

In  the  standard  process  (a  Hermite  process),  the  function 
f (u)  is  approximated  by  a cubic,  and  the  coefficients  of 
the  cubic  arc  determined  from  the  values  of  the  ordinate 

f(  <)  and  the  slope  f (n)  at  two  points  and  , chosen 

a 1 z 

so  tliat  f (a,)  ' 0 and  f (<x„)  ■ 0.  In  an  alternative 

< J ti  2 

process  (Ref.  5),  the  coefficients  of  the  cubic  are  de- 
termim?!)  from  1 lie  x’niue.s  ni  tlin  (Tniinate  f ( 0 at  four  j)oints. 
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I 

I Another  widely  used  search  scheme  is  the  quadratic 

interpolation  process  (see  Refs.  6-7).  In  the  standard 
I process,  the  function  f (a)  is  approximated  by  a quadratic, 

and  the  coefficients  of  the  quadratic  are  determined  from 
* the  values  of  the  ordinate  f (a)  at  three  points.  In  an 

I alternative  process  (Ref.  8) , the  coefficients  of  the 

quadratic  are  determined  from  the  values  of  the  ordinate 
I f (ex)  at  two  points  and  the  slope  f^(c()  at  one  point, 

j In  this  paper,  we  consider  the  Hermite  cubic  interpola- 

tion process,  and  we  present  some  modifications  of  the 
process,  designed  to  improve  the  robustness  of  the  method 
and  force  the  process  to  converge  in  a reasonable  number  of 
iterations,  even  in  pathological  cases.  The  function  f (rx) 
is  approximated  in  the  same  way  as  in  the  standard  process, 
but  a new  feature  is  added:  a bisection  of  the  interval  of 

interpolation,  which  is  done,  either  nonoptionally  or 
optionally,  in  accordance  with  certain  rules  described  in 
Section  3. 

Next,  an  alternative  to  the  cubic  interpolation  process 
is  presented  in  Section  4.  This  is  a Lagrange  interpolation 
scheme,  in  which  a quadratic  approximation  to  the  derivative 
of  the  function  is  considered.  The  coefficients  of  the 
quadratic  polynomial  are  determined  from  the  values  of  the 
slope  0 at  three  points:  . The  points 

and  (t„  are  such  that  f ( i,  ) ^ 0 and  f ( t„)  ■ 0.  And  the 

point  is  equidistant  from  the  previous  two.  Rules  are 
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provided  for  the  automatic  updating  of  the  interval  of 
interpolation . 

In  order  to  avoid  numerical  instabilities,  a switching 
parameter  is  introduced  in  both  the  cubic  interpolation 
process  and  the  proposed  alternative.  This  parameter  de- 
pends on  the  relative  magnitude  and  the  signs  of  the  co- 
efficients appearing  in  the  polynomial  approximations  to 
f (a)  and  f^(a).  It  governs  the  switch  from  the  cubic  to  the 
quadratic  approximation  for  f (a)  and  the  switch  from  the 

qu"'  ' tic  to  the  linear  approximation  for  f (a)  . For  an 

a 

•five  switching  parameter,  see  Ref.  9. 
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2 . Review  of  Cubic  Interpolation 
Consider  a unimodal  function 


f = f(a)  , 


where  a is  a scalar.  Assume  that  the  minimum  of  the  function 
occurs  for  some  value  which  is  finite  and  positive.  Next, 
consider  the  reference  stepsize  a*  and  the  sequence  of  step- 


ja}  = jo,  a*,  2a*,  4a*,  8a*,  ... 


For  every  element  of  the  sequence  (2),  compute  the  ordinate 

f(a)  and  the  slope  f (a).  Denote  by  a.  and  a„  the  smallest 

u -'12 

consecutive  elements  of  the  sequence  (2)  such  that  the  follow- 
ing inequalities  are  satisfied: 


f^(ai)  < 0 , f^^Ca^)  0 . 


Then,  assuming  that  the  derivative  is  continuous,  the 

minimum  of  f (a)  occurs  for  a value  a sucli  that 

o 


a.  < ct  < a_ 
1 o 2 


In  order  to  find  the  minimum  of  f(.)  numerically, 


For  simplicity,  wo  assume  that  f (0)  • 0. 

* 
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we  represent  the  function  f(a)  in  the  cubic  form 

2 3 

F(a)  = Rq  + k^cx  + k20t  + k^a  . (5) 

The  coefficients  k^  are  computed  by  forcing  the  cubic  F(a) 
and  its  derivative  to  satisfy  the  exact  values  of  the 

ordinate  f (a)  and  the  slope  st  and  ; that  is, 

the  coefficients  k^  are  computed  from  the  conditions 

F(a^)  = f(a^)  , ^ 

F(a2>  = ~ 

With  the  coefficients  known,  an  approximation  to  the 
optimum  stepsize  is  obtained  by  determining  the  zero  of 
the  first  derivative  of  (5) , subject  to  the  convexity  con- 
dition for  the  cubic  representation  (5),  that  is. 


Equation  (8-1),  in  combination  with  Ineq.  (8-2)  and  Eqs. 
(5)- (7),  implies  that  (Ref.  10) 


= a^tp,^(a2- 
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' where 

I 

I 

2 

= (l/3c^)  [-C2  + V'' (c2-3c^C2  ) ] , if  p ^2  or  O2  £ 0 ; 

Bq  = ^2  ^2  ^ ^ ■ 

In  Eqs.  (10),  the  coefficients  c^ , C2,  c^  are  given  by 
Cl  = (cx2-a^)  f^(a^)  , 

^ C2  = 3 [f  (a2) -f  (c(j^)  ] - (a2“a^)  [2f^  (a^) +f^  (a2)  ] , 

c^  = 2 [ f (a^) -f  (a2)  ] + {a2~“i^  t (™2  ^ ^ ' 

6 

and  the  switching  parameter  p is  given  by 
p = I 3c^c^/c^  I 

Use  of  (10-2)  in  place  of  (10-1)  corresponds  to  sotting  1<2  = 0 
in  Eq.  (5);  that  is,  it  corresponds  to  replacing  the  cubic 
apfjroximation  F(a)  with  a quadratic  approximation.  For  the 
details,  see  Ref.  10. 

Iterative  Froccdure.  At  the  end  of  any  iteration,  an 

^An  alternative  switching  parameter  is  presented  by  Acton  in 
Ref . 9 . 

L 


(10-1) 

(10-2) 

(11-1) 

(11-2 

(11-3) 

(12) 
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approximate  optimum  stepsize  is 
arise,  depending  on  the  sign  of 


known.  Then, two  possibilities 

f (a)  at  the  point  a : 
a o 


Case  (i)  , f (a  ) > 0 

a o 


(13-1) 


Case  (ii) 


f (a  ) < 0 
a o 


(13-2) 


If  the  tilde  denotes  quantities  pertaining  to  the  next  it- 
eration, the  resetting  of  and  Q2  is  done  as  follows: 


Case  (i)  , 

Case  (ii)  , 

The  iterative  process 
size  a satisfies  the 


is  terminated  whenever 
inequality 


(14-1) 

(14-2) 

the  optimum  step- 


f 

■1 


•? 


^a<“o^  I 1 


(15) 


where  is  a small,  positive  number. 

Concerning  function  evaluations,  the  conclusions  are  as 
follows.  For  the  first  iteration,  one  needs  to  evaluate  two 
functions  and  two  derivatives.  For  subsequent  iterations,  one 
needs  to  evaluate  only  one  additional  function  and  one  ad- 
ditional derivative,  since  t)ic  values  of  the  function  and  its 
derivative  at  the  endpoints  of  t)ie  previous  interval  arc 


is 


■-‘4 

i 


known  and  stored. 
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3.  Modi f ications  of  the  Cubic  Interpolation  Process 

Generally  speaking,  the  cubic  interpolation  process  de- 
scribed in  Section  2 enables  one  to  find  the  minimum  of  a 
unimodal  function  ia  a relatively  small  number  of  iterations. 

However,  it  is  known  that  pathological  cases  can  be  con- 
structed such  that  this  process  might  become  slow  and  in- 
efficient: for  some  extremely  flat  bowl  functions  (see  j 

Examples  5.21  and  5.22),  the  previous  algorithm  might  be  un-  I 

able  to  converge  in  several  hundred  iterations.  ] 

In  an  effort  to  bypass  the  above  difficulty,  we  present  I 

I 

here  two  modifications  of  the  previous  process.  The  basic  i 

'•i 

idea  is  to  force  a substantial  reduction  of  the  interval  of 
interpolation  through  a bisection  procedure,  which  can  be 
either  nonoptional  [Modification  Ml]  or  optional  [Modification 
M2]  . 

We  emphasize  that,  in  the  modifications  described  below, 

Eqs.  (9) -(12)  are  retained.  However,  the  updating  formulas 
(13)- (14)  are  discarded  and  are  replaced  by  new  updating 
formulas,  designed  to  force  a more  drastic  reduction  in  the 
interval  of  interpolation. 

Modification  Ml.  Suppose  that  Eqs.  (9)- (12)  are  em- 
ployed in  any  given  iteration.  Also,  suppose  that,  prior  to 


starting  the  next  iteration,  the  interval  of  interpolation 
associated  with  the  procedure  of  Section  2 is  bisected  through 
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the  consideration  of  the  following  intermediate  stepsize: 

013  = (a^+u^)/2  , if  > 0 ; (16-1) 

“3  " ° • (16-2) 

Then,  four  possibilites  arise,  depending  on  the  signs  of  the 

slope  f (a)  at  a and  a-,: 
a o 3 
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Case  (iv)  , . (18-4) 

It  can  be  shown  that  any  two  consecutive  intervals  of  inter- 
polation satisfy  the  inequality 

< ((i^-n^)/2  . (19) 

Consequently,  Modification  Ml  should  behave  in  a reasonable 
way,  even  in  the  pathological  cases  described  previously.  Of 
course,  the  iterative  [procedure  is  terminated  whenever  Ineq. 

(15)  is  satisfied. 

Concerning  function  evaluations,  the  conclusions  are  as 
follows.  For  the  first  iteration,  one  neecis  to  evaluate  two 
functions  and  two  derivatives.  For  subsequent  iterations, 
one  needs  to  evaluate  two  additional  functions  and  two  ad- 
ditional derivatives.  Therefore,  while  Modification  Ml  is 
more  robust  than  the  standard  cubic  interpolation  process  of 
Section  2,  a price  must  be  paid  in  terms  of  function  evalua- 
tions . 

Modification  M2.  This  modification  has  characteristics 
which  are  intermediate  between  those  of  the  standard  cubic 
interpolation  [jrocoss  and  those  of  Modification  Ml.  It  con- 
stitutes an  attempt  to  retain  the  robustness  characteristics 
of  Modification  Ml,  while  trying  to  reduce  the  total  number 
of  function  evaluations  and  derivative  evaluations. 
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Basic  to  Modification  M2  is  the  consideration  of  two 
consecutive  optimum  stepsizes  and  . Depending  on  the 
signs  of  the  slope  at  and  , two  cases  are  possible: 

Case  (a)  , f^{a^)f^(a^)  < 0 ; (20-1) 

Case  (b)  , f ^ (a^)  f ^ (a^)  > 0 . (20-2) 

For  each  of  these  cases,  the  next  interval  of  interpolation  is 
determined  as  follows: 

Case  (a)  , use  updating  rules  (13)-(14)  ; (21-1) 

Case  (b)  , use  updating  rules  (17)-(18)  . (21-2) 

The  significance  of  the  strategy  described  by  (20)- (21) 

is  as  follows.  For  Case  (a),  (20-1)  indicates  that  the  signs 

of  f (a  ) and  f (a  ) are  different,  meaning  that  the  actual 
a o a o 

optimal  stepsize  lies  inside  the  interval  enclosed  by  cl^  and 
; therefore,  bisection  is  not  applied.  For  Case  (b) , (20-2) 

indicates  that  the  signs  of  f (a  ) and  f (a  ) are  the  same, 
meaning  that  actual  optimal  stepsize  lies  outside  the  interval 
enclosed  by  a and  a ; therefore,  bisection  is  applied. 

In  essence.  Modification  M2  proceeds  as  follows:  For 


L. ^ 
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Case  (a),  we  employ  the  cubic  interpolation  process  in  its 
standard  form;  while,  for  Case  (b) , we  employ  Modification 
Ml . 


1 
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4 . Alternatives  to  the  Cubic  Interpolation  Process 

An  alternative  to  the  cubic  interpolation  process  is  a 
Lagrange  interpolation  scheme:  instead  of  employing  the 

values  of  f(a)  and  f^(“)  at  two  points,  we  employ  the  values 
of  at  three  points. 

The  computational  procedure  is  as  follows.  We  consider 

the  sequence  of  stepsizes  (2)  and,  for  every  element  of  the 

sequence,  we  compute  the  derivative  f (a) . We  denote  by  a, 

a -'I 

and  the  smallest  consecutive  elements  of  the  sequence  (2) 
such  that  Ineqs.  (3)  are  satisfied.  Next,  we  denote  by 

= (a^+a2)/2  (22) 

the  point  equidistant  from  the  previous  two  and,  at  this 
point,  we  compute  the  slope  1^(0^). 

In  order  to  find  the  minimum  of  f (a)  numerically,  we 
represent  the  derivative  f^(a)  in  the  quadratic  form 

F^(a)  = • (23) 

The  coefficients  p^  are  computed  by  forcing  the  quadratic 
(23)  to  satisfy  the  exact  values  of  the  slope  f(^(a)  at 
, ct2»  is,  the  coefficients  p^  are  computed  from 
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the  conditions 

which  represent  a Lagrange  interpolation  scheme  with  equi- 
distant arguments. 

With  the  coefficients  known,  an  approximation  to  the 

optimum  stepsize  is  obtained  by  determining  the  zero  of 

F (a) , subject  to  the  positiveness  condition  for  F (a). 

“ eta 

Equation  (8-1) , in  combination  with  Ineq.  (8-2)  and  Eqs. 
(23)-(24),  implies  that  (Ref.  10) 

“o  (»^+a^)/2  + /2  , 


where 


Vq  = (l/2q^)  [-q^  + ] , if  a > t ^ ; 

'o  " ’ if  a < 

In  Eqs.  (26),  the  coefficients  c]^,  q^,  q^  are  given  by 


q 


1 


(24) 


(25) 

(2G-1) 

(2G-2) 


f ('».) 
(X  3 


(27-1 ) 


(u^)  - (a^)  1/2  , 


and  the  switching  parameter  o is  given  by 
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(27-2) 


(27-3) 


Use  of  (26-2)  in  place  of  (26-1)  corresponds  to  setting  p^=0 
in  Eq.  (23);  that  is,  it  corresponds  to  replacing  the  quadratic 
approximation  to  the  derivative  with  a linear  approxi- 

mation. For  the  details,  see  Ref.  10. 

Version  A1 . In  this  version,  two  possibilities  arise, 
depending  on  the  sign  of  at  the  point  : 


Case  (i) , f (a  ) > 0 ; 

a o 


Case  (ii)  , f (a  ) < 0 
a o 


(29-1) 


(29-2) 


The  resetting  of  and  is  done  as  follows; 


Case  (i)  , 5^^  = , ri^  = ; 


Case  (ii)  , " *^0  ' ''2  ~ '‘2 


(30-1) 


(30-2) 
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The  iterative  process  is  terminated  whenever  the  optimum  stej^- 
size  satisfies  Ineq.  (15). 

Concerning  function  evaluations,  the  conclusions  are  as 
follows.  For  the  first  iteration,  one  needs  to  evaluate  three 
derivatives.  For  subsequent  iterations,  one  needs  to  evaluate 
two  additional  derivatives,  since  the  values  of  the  deriva- 
tives at  the  endpoints  of  the  previous  interval  are  known 
and  stored. 

Version _A2.  In  this  version,  four  possibilities  arise, 
depending  on  the  signs  of  at  points  and  : 


Case  (i),  f (a,)  >0  , f (u  ) > 0 ; (31-1) 

u i no 

Case  (ii),  > 0 , ^^^'■'*0'  ° ' (31-2) 

Case  (iii),  f^(n2)  ^0  , ^ ® ' (31-3) 

Case  (iv) , f (a^)  <0  , f (n  ) ^ 0 . (31-4) 

n 3 no 


The  resetting  of  and  is  done  as  follows: 


Case  ( i i ) , 


o 


'3 


(32-2) 
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Case  (iii),  d,  = , 5„  = a ; (32-3) 

13  2 o 

Case  (iv),  d^  = . (32-4) 


The  iterative  process  is  terminated  whenever  the  optimum  step- 
size  satisfies  Ineq.  (15). 

Concerning  function  evaluations,  the  conclusions  are  as 
follows.  For  the  first  iteration,  one  needs  to  evaluate  three 
derivatives.  For  subsequent  iterations,  one  needs  to  evaluate 
two  additional  derivatives,  since  the  values  of  the  derivatives 
at  the  endpoints  and  the  middlepoint  of  the  pr-'^vious  interval 
are  Icnown  and  stored. 


Remark.  Concerning  the  reduction  of  the  interval  of  ] 

4 

interpolation.  Version  A1  does  not  have  any  particular  | 

property.  On  the  other  hand,  Version  A2  is  such  that  any  two 

consecutive  intervals  of  interpolation  satisfy  the  inequality  ! 

I 

I 


I 
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Experimental  Conditions  and  Numerical  Examp 1 e s 


In  order  to  evaluate  and  compare  the  previous  algorithms, 
twenty-nine  numerical  examples  were  solved.  The  algorithms 
were  programmed  in  FORTRAN  IV,  and  the  numerical  results  were 
obtained  using  the  IBM  370/155  computer  of  Rice  University  and 
double-precision  arithmetic. 

For  all  of  the  examples,  the  reference  stepsize 


(i  ^ 1 


(34: 


was  employed,  that  is,  the  sequence  of  stepsizes  explored  was 
chosen  as  follows: 


ja}  = {0,1, 2, 4, 8,  } 


35: 


The  algorithms  were  programmed  to  stop  whenever  Ineq.  (15] 
was  satisfied  with 


r^  = 10^  or  fj^  = 10^*^ 


(36) 


The  switching  constant  appearing  in  (10)  and  (26)  was  set 


at  the  level 


= 10 


-10 


(37; 
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The  twenty-nine  functions  investigated  are  described 

by  Eqs.  (38) -(66).  For  these  functions,  Table  1 supplies 

the  abscissa  of  the  minimal  point  , the  value  of  the 

function  at  the  minimal  point  f (u  ) , and  the  value  of  the 

^ o 


second  derivative  at  the  minimal  point  f (a  ) 

0.0.0 


Of  course, 


at  the  minimal  point,  one  has  f (a  ) = 0 v/ithin  the  degree 

a o 

of  precision  established  by  (36-2). 


Example  5 , 1 

f(a)  = (2a-4.5) '^-75a+295  ; (38) 

Example  5.2 

f (a)  = a^/6-3a  ; (39) 

Example  5.3 

f(a)  = 6/(0.0005+a)+15/(1.0005-a)  ; (40) 

Example  5 . 4 

f (a)  = [exp  (a-/7T) -a+Z-rr-l]  (a-Zir)  (a-/TT)  ^ ; (41) 

Example  5.5 

f(a)  = [exp (a-e^) -a+e^-1] (a-e^) (a-e^) ^ ; (42) 

Example  5.6 

f(a)  = [exp (a-3 ) -a+2 ] (a-3 ) ( a-3 ) ^ ; (43) 

Example  5 . 7 

f (a)  = exp  [ (a-TT ) ^ + 10  (a-TT ) *^  ] ; (44) 


7 

The  symbol  e in  Eq . 
logarithms . 


(42)  denotes  the  basis  of  natural 
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Example  5. 8 


f (cO 

= 

5 

-10  cos  rx-a  ; 

(45) 

Example 

^._9 

f (a) 

= 

5 

-10  0 cos  a-(x  ; 

(46) 

Example 

5.10 

f (u) 

= 

5 

-1000  cos  a-Qc  ; 

(47) 

Example 

5.11 

f (a) 

= 

1 n 4 

-10  cos  a-a  ; 

(48) 

Example 

5.12 

f (a) 

= 

4 

-100  cos  a-a  ; 

(49) 

Example 

5.13 

f (a) 

= 

4 

-1000  cos  cx-a  : 

(50) 

Example 

5.14 

f (a) 

= 

100  cos  a-a  ; 

(51) 

Example 

5.15 

f (a) 

= 

cos^  (a+Ti/6 ) ; 

(52) 

Example 

5.16 

f (a) 

= 

9 

cos  (a+TT/6)  ; 

(53) 

rcxample 

5.17 

f ((x) 

= 

500  cos^ ( a+n/6 ) -a  ; 

(54) 

Example 

5.18 

f (u) 

= 

-TTa/ 4-71^0^  + 100  sin'^(TT.x/4)  ; 

(55) 

Example 

5.19 

f (a) 

= 

1 -exp  I - (a-+ ) ^ 1 ; 

(56) 
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Example 

5.20 

f (a) 

= 

1-10  exp  [- (a-ir)  ; 

(57) 

Example 

5.21 

f (a) 

= 

1-exp  I- ( 2a-Ti  + 2 ) ® ] ; 

(58) 

Example 

5.22 

f (a) 

= 

1-10  exp  [- (2a-TT+2)  ; 

(59) 

Example 

5.23 

f (a) 

= 

lOO-lOa+0.05  sinh(20a)  ; 

(60) 

Example 

5.24 

f (a) 

= 

99-lOa+cosh (20a)  ; 

(61) 

Example 

5.25 

f (a) 

= 

lOO-lOa+0. 05a^sinh (20a)  ; 

(62) 

Example 

5.26 

f (a) 

= 

99-lOa+a^cosh (20a)  ; 

(63) 

Example 

5.27 

f (a) 

= 

lOO-lOOOOa+0 . 05a^sinh (20a)  ; 

(64) 

Example 

5.28 

f (a) 

= 

100  cos (sinh  a)  ; 

(65) 

Example 

5.29 

f (a) 

= 

cos [exp (a-1/3) ] 

(66) 

J 
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Table  1.  Solutions  for  the  numerical  examples. 


Example 

a 

o 

f (a 

o^ 

f ( 

acx 

5.1 

0.3304 

E+01 

0.6694 

E+02 

0.2134 

E+03 

5.2 

0.1245 

E+01 

-0.  3114 

E+01 

0.1204 

E+02 

5.3 

0.3873 

E+00 

0.3993 

E+02 

0.  3358 

E + 03 

5.4 

0.1772 

E+01 

0 .0000 

E + 00 

0.2000 

E+01 

5.5 

0.7389 

E+01 

0 . 0000 

E+00 

0.2000 

E+01 

5.6 

0.3000 

E+01 

0.0000 

E+00 

0.2000 

E+01 

5.7 

0.3141 

E+01 

C.IOOO 

E+01 

0.2000 

E+01 

5.8 

0.2001 

E-01 

-0.1001 

E+02 

0.4986 

E + 02 

5.9 

0.2000 

E-02 

-0.1000 

E+03 

0.4999 

E + 0 3 

5.10 

0.2000 

E-03 

-0.1000 

E+04 

0.4999 

E+04 

5.11 

0.2502 

E-01 

-0 .1001 

E+02 

0.3987 

E+0  2 

5.12 

0.2500 

E-02 

-0.1000 

E+03 

0.3999 

E+0  3 

5.13 

0 .2500 

E-03 

-0.1000 

E+04 

0. 3999 

E+04 

5.14 

0.3151 

E+01 

-0.1031 

E+03 

0.9999 

E+02 

5.15 

0.2617 

E+01 

-0.1000 

E+01 

0.5000 

E+01 

5.16 

0.2617 

E+01 

-0.1000 

E+01 

0.9000 

E + 01 

5.17 

0.2618 

E+01 

-0. 5026 

E+03 

0.2499 

E + 04 

5.18 

0.7790 

E+00 

-0.4539 

E+01 

0.7989 

E+02 

5.19 

0.3141 

E+01 

0.0000 

E+00 

0 .2000 

E+01 

5.20 

0. 3141 

E+01 

-0.9000 

E+01 

0.2000 

E+02 

5.21 

0.5707 

E+00 

0.0000 

E+00 

0.0000 

E+00 

5.22 

0.5707 

E+00 

-0.9000 

E + 01 

0.0000 

E + 00 

5.23 

0. 1496 

E+00 

0.9900 

E + 02 

0.  1989 

E+0  3 

5.24 

0.2406 

E-01 

0.9987 

E+02 

0.4472 

E+03 

5.25 

0. 3415 

E+00 

0.9689 

E+0  2 

0. 3062 

E+0  3 

5.26 

0.2487 

E+00 

0.9678 

E+02 

0.3428 

E-t  0 3 

5.27 

0. 5870 

E+0  0 

-0.5397 

E + 04 

0.2638 

E+06 

5.28 

0.1862 

E+01 

-0.1000 

E + 03 

0.1086 

E+04 

5.29 

0.1478 

E+01 

-0. 1000 

E+01 

0.9869 

E+01 
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6 . Numerical  Results,  Discussion,  and  Conclusions 

In  this  paper,  the  numerical  solution  of  the  problem  of 

minimizing  a unimodal  function  f(o)  is  considered,  where  a 

is  a scalar.  Two  processes  are  studied.  One  is  the  cubic 

interpolation  process,  in  which  the  coefficients  of  the 

cubic  approximation  to  the  function  are  determined  from  the 

values  of  the  ordinate  f (a)  and  the  slope  f (a)  at  two  points 

a ‘ 

n,  and  a„  , chosen  so  that  f (a,)  < 0 and  f (a„)  > 0.  The 
12  a 1 a 2 

other  is  an  alternative  to  the  former  process,  in  which  the 
coefficients  of  the  resulting  quadratic  approximation  to  the 
derivative  of  the  function  are  determined  from  the  values  of 
the  slope  at  three  points,  namely,  a^,  and 

= {a^+a2)/2.  Therefore,  the  cubic  interpolation  process 
is  replaced  by  a Lagrange  interpolation  scheme  based  on  three 
points  with  equidistant  arguments. 

The  iterative  procedure  for  the  cubic  interpolation  pro- 
cess is  investigated  in  three  schemes:  the  standard  process 

SP,  Modification  Ml,  and  Modification  M2.  Modification  Ml 
includes  the  nonoptional  bisection  of  the  interval  of  inter- 
polation, and  Modification  M2  includes  the  optional  bisection 
of  the  interval  of  interpolation,  in  accordance  with  the  rules 
of  Section  3, 


The  iterative  procedure  for  the  alternative  process  is 
investigated  in  two  schemes:  Version  A1  and  Version  A2.  Each 
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version  involves  different  updating  rules  for  the  endpoints 
of  the  interv^al  of  interpolation , in  accordance  with  the 
rules  of  Section  4. 

The  resulting  algorithms  are  compared  through  29  nu- 
merical examples.  For  these  examples,  Tables  2 and  3 show 
the  number  of  iterations  for  convergence  N to  the  stopping 
condition  (36-1)  or  the  stopping  condition  (36-2). 

Comparison  of  Algorithms . Inspection  of  Tables  2 and 
3 shows  that  the  standard  cubic  interpolation  process  SP 
fails  to  converge  in  two  examples  (Examples  5.21  and  5.22), 
while  the  proposed  modifications  and  alternatives  converge 
in  every  case. 

For  the  27  examples  where  all  of  the  algorithms  converge, 
it  is  of  interest  to  compute  the  cumulative  number  of  itera- 
tions for  convergence  This  yields  the  data  summarized 

in  Table  4 . 

Starting  from  the  above  data,  one  can  comiiute  the  average 
relative  change  in  number  of  iterations  for  convergence,  by 
comparison  with  Algorithm  SP.  This  yields  the  data  summarized 
in  Table  5. 

It  becomes  evident  that  Algorithms  Ml  and  A2  are  the 
best  among  those  presented  in  this  pafier.  However,  one  must 
remember  that  one  iteration  of  Algorithm  Ml  or  Altjorithm  A2 
takes  longer  than  one  iteration  of  Alqorithm  SP . Therefore, 
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there  is  clearly  a trade  off  between  robustness  and  rapidity 
of  convergence. 

Detailed  Behaviour  of  tlie  Algorithms.  For  one  particular 
example  (namely,  Example  5.29)  and  for  the  stopping  condition 
(36-1),  the  detailed  behavior  of  the  five  algorithms  investi- 
gated is  illustrated  in  Tables  6-10. 

Supplementary  Computations.  After  completion  of  this 
work.  Examples  5.1  through  5.29  were  rerun  by  replacing  the 
stopping  condition  (15)  with  the  stopping  condition 


Here,  denotes  the  optimum  stepsize  associated  with  the 
present  iteration,  and  denotes  the  optimum  stepsize  assoc- 
iated with  the  previous  iteration.  For  these  supplementary 
runs,  results  qualitatively  consistent  with  those  of  Tables  2 
and  3 were  obtained,  even  though  some  slight  changes  were 
detected  in  the  number  of  iterations  for  convergence. 
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Table  2. 


Number  of  iterations  for  converyence  N, 


= 10 


I- 

It 


Algorithm 

Example  


SP 

Ml 

M2 

A1 

A2 

5.1 

4 

4 

4 

4 

4 

5.2 

4 

3 

4 

4 

4 

5.3 

6 

4 

5 

5 

5 

5.4 

3 

2 

3 

3 

3 

5.5 

5 

4 

4 

5 

5 

5.6 

4 

3 

3 

1 

1 

5.7 

7 

4 

7 

6 

6 

5.8 

2 

2 

2 

4 

4 

5.9 

2 

2 

2 

5 

4 

5.10 

2 

3 

2 

5 

4 

5.11 

5 

4 

5 

6 

4 

5.12 

5 

4 

5 

6 

5 

5.13 

5 

4 

5 

6 

5 

5.14 

7 

4 

5 

7 

3 

5.15 

5 

5 

4 

5 

4 

5.16 

4 

5 

4 

6 

3 

5.17 

6 

6 

5 

6 

4 

5.18 

4 

3 

3 

4 

4 

5.19 

6 

4 

5 

7 

3 

5.20 

7 

5 

6 

8 

3 

5.21 

•100 

3 

4 

3 

3 

5.22 

>100 

4 

4 

4 

4 

5.23 

7 

5 

6 

6 

6 

5.24 

7 

5 

6 

7 

7 

5.25 

6 

5 

7 

7 

7 

5.26 

8 

5 

5 

5 

5 

5.27 

7 

5 

6 

7 

7 

5.28 

5 

3 

4 

5 

4 

5.29 

1 5 

4 

5 

12 

2 

'1 


4 

i 

1 

f 
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Table  4 . 

Cumulative 

number  of 

i terat 

i-ons  for  c 

:onvergence  ! 

Stopping 

condition 

Algorithm 

SP 

Ml 

M2 

A1  A2 

^1 

10"^ 

148 

107 

122 

152  116 

= 

o 

1 

o 

216 

149 

158 

227  ]44 

j Tabic  5.  Average  relative  change  in  number  of  iterations  for 


convergence,  by 

comparison 

with  the 

standard 

process . 

Algorithm 

Stopping 

r'oorl  1 T o n 

1 itiA  X t,  ^ 1 X 

SP 

Ml 

M2 

A1 

A2 

lo"^  0.0% 

-27.7% 

-17.6% 

+ 2 . 7% 

-21.6% 

^1  = 

10"^°  0.0% 

-31 .0% 

-26.8% 

+ 5.1% 

-33.3% 

i 
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Table 

6.  Results 

for  Example  5. 

29,  c^=10  ^ 

Algorithm  SP. 

N 

a 

f (a) 

f (a) 

u 

a a 

1 

1 , 37834 

-0.955878 

-0.835299 

6.89306 

2 

1.43827 

-0.992500 

-0.369056 

8.67721 

3 

1.46150 

-0.998668 

-0.159416 

9.37583 

4 

1.47107 

-0.999760 

-0.068276 

9.66196 

5 

1.47510 

-0.999957 

-0.029141 

9.78167 

6 

1.47680 

-0.999992 

-0.012420 

9.83225 

7 

1.47753 

-0.999999 

-0.005290 

9.85372 

8 

1.47783 

-1.000000 

-0.002253 

9.86284 

9 

1.47797 

-1.000000 

-0.000959 

9.86673 

10 

1.47802 

-1.000000 

-0.000408 

9.86838 

11 

1.47805 

-1.000000 

-0.000174 

9.86908 

12 

1.47806 

-1.000000 

-0.000074 

9.86938 

13 

1.47806 

-1.000000 

-0.000032 

9.86951 

14 

1.47806 

-1.000000 

-0.000013 

9.86956 

15 

1.47806 

-1.000000 

-0.000006 

9.86959 
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Table  7.  Results  for  Example  5.29,  Cj^=10  Algorithm  Ml. 


N 

fX 

f (a) 

f„(a) 

f (a) 
aa 

1 

1 . 37834 

-0.955878 

-0.835299 

6.89306 

2 

1.47608 

-0.999980 

-0.019521 

9.81081 

3 

1.47805 

-1.000000 

-0.000120 

9.86924 

4 

1.47806 

-1 . 000000 

-0.000000 

9.86960 

Table 

8.  Results 

for  Example  5. 

29,  e^=10~^. 

Algorithm  M2. 

N 

(X 

f (a) 

f (ex) 

f (a) 

a 

acx 

1 

1 . 37834 

-0.955878 

-0.835299 

6.89306 

2 

1 .43827 

-0.992500 

-0.369056 

8.67721 

3 

1.47606 

-0.999980 

-0.019664 

9.81038 

4 

1.47805 

-1.000000 

-0.000174 

9.86908 

5 

1 .47806 

-1 . 000000 

-0.000000 

9.86960 
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Table 

9,  Results 

for  Example  5. 

29,  t^=10 

Algorithm  Al. 

N 

a 

f (a) 

f (u) 

f (a) 

a 

aa 

1 

1.46319 

-0.998925 

-0.143476 

9.42662 

2 

1.47206 

-0.999823 

-0.058742 

9.69129 

3 

1.47562 

-0.999971 

-0.024046 

9.79712 

4 

1.47706 

-0.999995 

-0.009843 

9.84002 

5 

1.47765 

-0.999999 

-0.004029 

• 

9.85751 

6 

1.47790 

-1.000000 

-0.001649 

9.86466 

7 

1.47799 

-1.000000 

-0.000675 

9.86758 

8 

1.47804 

-1.000000 

-0.000276 

9.86878 

9 

1.47805 

-1.000000 

-0.000113 

9.86927 

10 

1.47806 

-1.000000 

-0.000046 

9.86947 

11 

1.47806 

-1.000000 

-0.000019 

9.86955 

12 

1.47806 

-1.000000 

-0.000008 

9.86958 

Table 

10.  Results 

-5 

for  Example  5.29,  Cj^=10  , 

Algorithm  A2 . 

N 

a 

f(a) 

a 

f (a) 
aa 

1 

1.46319 

-0.998925 

-0.143476 

9.42662 

2 

1 .47806 

-1 . 000000 

-0.000006 

9.86959 
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